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Abstract — Bilevel signal x with maximal local rate of innova- 
tion i? is a continuous-time signal that takes only two values 
and 1 and that there is at most one transition position in any time 
period of l/R. In this note, we introduce a recovery method for 
bilevel causal signals x with maximal local rate of innovation R 
from their uniform samples x*h{nT),n > 1, where the sampling 
kernel h is causal and positive on (0, T), and the sampling rate 
r :— 1/r is at (or above) the maximal local rate of innovation R. 
We also discuss stability of the bilevel signal recovery procedure 
in the presence of bounded noises. 

I. Introduction 

Let T > and A^ be a nonnegative integer or infinity, and 
denote by xe the indicator function on a set E. In this note, 
we consider bilevel causal signals 



N 

4=1 



(1) 



with unknown transition values (positions) i^ , 1 < i < 2N, 
satisfying 

U < U+i, l<i<2N; (2) 



and also a uniform generalized sampling process 

x(t) I — > X * h{t) I — > {x * h{nT)}n>i 



(3) 



with sampling kernel h being causal and uniform sampling 
taken every T seconds. For the bilevel causal signal x in (fTl), 
define its maximal local rate of innovation R by reciprocal 
of the maximal positive number co such that there is at most 
one transition position t^, 1 < i < 2N, in any time period 
[t,t + aQ),t > 0, that is, 

R= sup -. (4) 



l<i<2Af t'i+l 



U 



The concept of signals with finite rate of innovation was 
introduced by Vetterli, Marziliano and Blu [l]. Examples of 
signals with finite rate of innovation include streams of Diracs, 
piecewise polynomials, band-limited signals, and signals in a 
finitely-generated shift-invariant space Ul-Ill- In the past ten 
years, the paradigm for reconstructing signals with finite rate 
of innovation from their samples has been developed, see for 
instance |T|, ^ and |l4l-|[T3| and references therein. 

Precise identification of transition positions is important to 
reach meaningful conclusions in many applications. Vetterli, 



Marziliano and Blu show in m that a bilevel signal x defined 
in ([T]) can be reconstructed from its samples ^ when the 
sampling kernel h is the box spline X[o.t) (or the hat spline 
(T — \t\)x[-T,T){t)) and the sample rate r :— 1/T is at (or 
above) the maximal local rate of innovation R of the signal x. 
In this note, we show that bilevel causal signals x defined in (|T|l 
are uniquely determined from their samples x * h{nT),n > 1, 
in ^ if the sampling kernel h is causal and positive on (0, T), 
and the sample rate r is at (or above) the maximal local rate 
of innovation R, see Theorem [T] Our numerical simulations 
indicate that the bilevel signal recovery procedure from noisy 
samples x*h{nT) + en, n > 1, is stable when there are limited 
numbers of transition positions for the bilevel signal x. 

II. Recovery of bilevel causal signals 

In this section, we provide a necessary condition on the 
sampling kernel h such that bilevel signals a: in (fill are 
uniquely determined from their samples {x * h{nT)} in ^. 
Also in this section, we propose an algorithm for the bilevel 
signal recovery. 

The main theorem of this note is as follows: 
Theorem 1: Let T > and set r = 1/T. If ft, is a causal 
sampling kernel with h{t) > on (0,T), then any bilevel 
causal signal a; in (fTl) with maximal local rate of innovation 
R being less than or equal to the sampling rate r can be 
recovered from its samples x * h{nT),n > 1. 

Proof: Let 



Hit) 



/ h{s)ds, 0<t<T. 
Jq 



(5) 



Then H{0) — and H is a strictly increasing function on 
[0,r) as h is strictly positive on (0,r). Denote its inverse 
function on [0,T] by R-^ : [0,H{T)] i — > [0,T]. 

Let X be a bilevel causal signal in (fTl) with transition 
positions ti,l < i < 2N, satisfying (|2|. Then its first sample 
Hi = X * h{T) is given by 



2/1 



x{t)h{T~t)dt= I x{t)h{T-t)dt 



I Xlt^,t,)it)h{T~t)dt^H{ma.x{T-h,0}), 



where the first two equahties hold by the causahty of the signal 
X and the sampling kernel h, and the fourth equality follows 
from ([TJ and the observation that 

U >t2 = {t2 - h) + ti > 1/i? + > 1/r = T, i>2 

by (|2]i, (J4]i and the assumption that R < t. Recall that H 
is strictly increasing on [0,r). Then there exists a transition 
position in the time range [0, T) if and only if j/i — x*h{T) > 
0. Moreover, if it exists, it is given by 



h=T-H-\y,). 



(6) 



Thus for a bilevel causal signal, we may determine from 
its first sample x * h{T) the (non-)existence of its transition 
position in the time period [0, T) and further its transition 
position in that time period if there is one. 

Inductively, we assume that all transition positions of the 
bilevel signal x in the time range [0, nT) have been determined 
from its samples yk — x * h{kT), 1 < k < n. We examine 
four cases to determine its transition position in the time period 
[nT, [n + 1)T) from the sample y^+i =x* h{{n + 1)T). 

Case 1: There is no transition position in [0,nT). 

In this case, following the above argument to determine 
transition positions in the time range [0,r), we have that 
there exists a transition position in [nT, {n+ l)T) if and only 
if yn+i > 0. If there is, the transition position is the first 
transition position ti of the bilevel causal signal x, and 



h = {n + l)T - H-\yn+i) 



(7) 



Case 2: The last transition position in [0,nT) is t2io-i fo'" 
some io > 1- 

In this case, ^210 — "-^ '^^'^ ti > {n + 1)T for all i > 2iQ. 
Thus 

An+1)T 

Vu+i = / x{t)h{{n + l)T-t)dt 







(n+l)T 



h{{n + l)T -t) 



io-l 



■ ( H X[t2,-i,t2.)(^) + Xfeo-i,(n+l)T) W)rft 



1=1 
(n+l)T 



nT 



h{{r 



l)T-t) 



'XXlmin(t2ioXn+l)T).in+l)T){t)dt. 

Hence there exists a transition position t2ia in the time range 
[nT, (n + 1)T) if and only if 



2/n+l 



-yn+i 



(n+l)T 



h{ir 



l)T-t) 



io — l 



^ ( H X[t2.-l,t2,) W + X[t2,„-u{n+l)T)it))dt (8) 
i=l 

is positive. Moreover if y„+i > 0, the transition position ^210 
in the time range [nT, {n+ 1)T) is determined by 



t2l 



(n+l)T-H~\yk+i). 



(9) 



Case 3: The last transition position in [0, nT) is ^2*0 f°i' 
some 1 < Jo < ^■ 

In this case, the {n + l)-th sample yn+i — x* h{{n + 1)T) 
is given by 



iT , «o 



Vn+\ 



•^0 i=i 



dt 



{n+l)T 



h{{n + l)T-t)dt. (10) 



min(t2io + l,(n+l)T) 

Thus there exists a transition value ^210+1 •= [f^T, {n + 1)T) if 
and only if 



iT , «o 



yn+l := Vn+l 



/ [T.xit2.-ut.m)Hiri + i)T-t)dt 

(11) 

is positive. Also we see that if jjn+i > 0, then the transition 
value t2io+i can be obtained by 



t2,o+i = {n + l)T-H-\yn+i). 



(12) 



Case 4: The last transition position in [0, nT) is t2N- 
In this case, all transition positions of the bilevel signal x 

have been recovered akeady. Hence the bilevel signal x is 

fully recovered. 

This completes our inductive proof. ■ 

From the above argument of Theorem [T] we can use the 
following algorithm to recover a bilevel causal signal a; in (fill 
from its samples x * h{nT), 1 <n < iir,where K > t2NT: 

Bilevel Signal Recovery Algorithm: 

Step T. If all samples yn — x * hijiT), 1 < n < if , are 
zero, then set x = and stop; else find the first 
nonzero sample, say y„g > 0, the first transition 
position of the bilevel signal x is located at f 1 := 
no - H^^iyna), and set n = no- 

Step 2: Do Step 2a if the last transition position in the 
time range [0, nT) is i2io-i for some io > 1; do 
Step 2b elseif the last transition position in the 
time range [0, nT) is i2io for some 1 < Jo < ^; 
and do Step 4 else. 

- Step 2a: Define i2io as in (|9| if 2/n+i in fSll 
is positive, else do Step 3. 

- Step 2b: Define i2io+i ^s in (fT2]i if ijn+i in 
( [TT] ) is positive, else do Step 3. 

Step 3: Set n — n + 1. Do Step 2 if n < X, and Step 

4 if n = K. 
Step 4: Stop as all transition positions ti,l < i < 2N, 

of the bilevel signal x are recovered. 

We finish this section with a remark that the requirement 
R < T in Theorem [T] can be relaxed to the following: There 
is at most one transition position ti,l < i < 2N, in each 
sampling range [nT, (n + l)r), n > 1. 



III. Stable recovery of bilevel causal signals 

In this section, we consider the maximal sampling error 
sup„ |a; * h{nT) — a; * h{nT)\ of two bilevel signals x and 
X when maximal error of their transition positions are small. 
We then present some numerical simulations on recovery of a 
bilevel signal a; in (fTji from its noisy samples {a;*/i(nT) + e„} 
in Q, where e„,ri > 1, are bounded noises of low levels. 

First we notice that sampling procedure from bilevel signals 
X to their samples {x * /i(nT)} are stable in bounded norm. 

Theorem 2: Let T > 0, /i be a bounded filter supported 
in [0, AfT), x{t) = EiIiX[t2i-i,t2,)(0 be a bilevel causal 
signal with maximal local innovation rate R < t := 1/T, and 



{x =¥ h{nT) + En} in dsll, where e„, n > 1, are bounded noises. 
Let us start by looking at two examples. 

Example 1: Take xiit) = YT=iX[2i-iai){'^) ^^ the orig- 
inal bilevel signal and ft-i(i) = X[o.2)(^) as the sam- 
pling kernel. For sufficiently small e > 0, define xi ^ = 

E^iX[(i+e)(2i-i),2(i+e)i)(*)- Then for every i > 1, the i- 
th transition positions of bilevel signals xi and xi,^ are i and 
i{l + e) respectively (hence their difference is ie that could be 
arbitrary large for sufficiently large i), but on the other hand, 
maximal sampling errors for those two bilevel signals xi and 
Xi e are bounded by e, 

5(0 = Er=i X[t2^-l+S2^-ut2^+S2^) ^^ ^ pcrturbation of the |a;;^^ * hi{n) - xi * hi{n)\ = \xi^e * hi{n) - 1| < e, n > I. 



^N 



bilevel signal x with perturbed transition positions {U + Si} 
satisfying 



2^ 



sup \U 

l<i<2N 



U\ < 



2R 



Then the sample errors between x*h{nT) and x*h{nT), n > 
1, are dominated by {[MRT\ +2)\\h\\aoS, i.e., 

|x*/i(rir)-£*/i(?ir)| < {[AIRT\+2)\\h\\^6, n > 1, (13) 

where ||/i||oo is the L°° norm of the sampling kernel h. 

Proof: By the assumption on maximal local innovation 
rate R of the bilevel signal x and the maximal transition 
position perturbation 6 between bilevel signals x and x, we 
have that 



2JV 



\xit)~iit)\ 



/ J Xii + [inin((5i,0),max 



(5.,o))(i)- 



This together with the support assumption for the sampling 
kernel h gives that 





x*h{nT) -x*h{nT)\ 
/ {x{t) ^ 5:{t))h{kT - t)dt 


^riT 2N 

< \\h\\oo / > ,Xt. + [min(<5,,0 
J(n-M)T ^^^ 


Therefore 





>c{5ifi))it)dt. 



\x * h{nT) — x * h{nT)\ 

< S\\h\\^#{U : U e [(n - M)T -6,nT + 6)} 

< S\\h\\^{[{MT + 2S)/{l/R)\+l) 

< 6\\h\\^{[MRT\+2), 

where the first inequality holds as ti e [{n — M)T — S, nT + 
5) if t, + [min((5i,0),max((5,,0)) and [{n ~ M)T,nT) have 
nonempty intersection, the second inequality is true as t^+i — 
ti > l/R for all 1 < i < 2N, and the last inequality follows 
from the assumptions that S < 1/{2R) and R < t. This 
proves the sampling error estimate (fT3]l between the bilevel 
causal signals x and x. ■ 

Now we consider the corresponding nonlinear inverse prob- 
lem how to recover a bilevel signal x from its noisy samples 



This leads to instability of the recovery procedure from 
samples {xi * hi{n)} to the bilevel signal xi in the presence 
of bounded noises. 

Example 2: Take xi and hi in Example [T] as the original 
bilevel signal and the sampling kernel respectively. Define 
^2,e = J2iLiXl2i-i+e,2z+<L){t) for Sufficiently small e > 0. 
Then for every i > 1 the difference between i-th transition 
positions of bilevel signals xi and X2,e is always e, and 
there is no difference between their n-th samples except 
for n = L This suggests that the recovery procedure from 
samples {xi * hi{n)} to the bilevel signal xi is not locally- 
behaved and the reconstruction error on transition positions 
could disseminate. 

From the above two examples, we see that the nonlinear 
recovery procedure from samples {x*h{n)} to bilevel signals 
X is unstable in the presence of bounded noises and that it 
is globally-behaved in general. In this note, we present some 
initial numerical simulations with small numbers of transition 
positions, sampling rate over maximal local rate of innovation 
and very low levels of noise. Detailed noise performance 
analysis and stable recovery in the presence of other types 
of noises will be discussed in the coming paper 

Take a sampling kernel /io(0 = ^X[o,i)(*) + (2i^l)X[i,2), 
and a bilevel signal 

Xo{t) — X[0.37914-9885)(0 + X[3. 1306,4.3440) (i) 

+X[5.7552,7.1820)(0 + X[8. 7423, 10. 1052) (0 
+X[11. 4200, 12. 6884) (0 (14) 

containing 10 transition positions, see Figure [T] Here transition 




Fig. L Bi-level signal xq (left) and sampling kernel ho (right) 
positions t", 1 < i < 10, of the bilevel signal xq are randomly 



selected so that t^^ - t°_i e [1.1, 1.9], 2 < i < 10. The bilevel 
signal xq in ( 14 1 has 0.8756 as its maximal local rate of 



innovation. We sample the convolution xq * hi between xq 
and hi every second, which generates the sampling vector 
^0 — {^0 * ''•(I); ... ,2^0 * ^(14)), and then we add bounded 
random noise to the sampling vector 



Ys = Fo + K^i 



, £14) 



with noise level 5 > 0, where e; € [— 1, 1], 1 < i < 14, are 
random noises. We apply the bilevel signal recovery algorithm 
in Section |ll] with some technical adjustment when the recon- 
structed transition position is approximately located at some 
sampling positions, and denote the first ten transition positions 
of the reconstructed bilevel signal xs by ii <s, . . . , <io,5. Define 
maximal error of first ten transition positions by 



P{5) = max \ti s 

l<i<10 ' 



i^\- 



We perform the bilevel signal recovery algorithm in Sec- 
tion lll| 50 times for every noise level 5 € [0,0.03]. The 
maximal value of P{5) after performing the algorithm 50 
times is plotted in Figure [2] with solid line, while the av- 
erage value of P{5) plotted with dashed line. Notice that 
maxi<„<i4 |xo * hi{n)\ = 0.9796. Thus the maximal error 
P{6) of transition positions is less than 10% when the noise 
level e — max„>i |e„| is at (or below) 2% of the maximal 
sample value max„>i \xa * hQ{nT)\, while some transition 
positions could not be recovered approximately when the noise 
level is above 3%. This indicates that our algorithm to recover 
the bilevel signal from its noisy samples is "reliable" only for 
low level of bounded noises. We doubt that it is because of the 
instability of the nonlinear recovery procedure in the presence 
of bounded noises. We will do the detailed noise performance 
analysis in the coming paper. 




bilevel signal recovery algorithm in the presence of bounded 
noise if the number of transition positions of bilevel signals is 
not large. We remark that the bilevel signal recovery algorithm 
proposed in this note is applicable when uniform sampling x*h 
every T second replaced by nonuniform sampling {x*h{sn)} 
with sampling density sup„>]^ |sn+i ~ Sn| < 7", and bilevel 

causal signal x — X]i=i X[t2i-i,i2i)(^) "^^^^ maximal local 
rate of innovation R < 1/T replaced by box causal signals 

X = J2i=i '^iXlt2i-i,t2i)i^) ^i'-h maximal local rate of innova- 
tion R < 1/(2T), where for every 1 < i < iV, c^ is height of 
the box located on the time period [t2i-i, t2i)- 
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Fig. 2. IVIaximal transition position error 



IV. Conclusion 

In this note, we show that bilevel causal signals x could 
be reconstructed from their samples x * h{nT),n > 1, if 
the sampling kernel h is causal and positive on (0, T) and 
if the sample rate is at (or above) the maximal local rate of 
innovation of the bilevel signal x. We also propose a stable 



